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ABSTRACT 


The power spectral density of the output symbol sequence of a convolu- 
tional encoder is computed for two different input symbol stream source 
models, namely, an NRZ signaling format and a first order Markov source. 

In the former, the two signaling states of the binary waveform are not neces- 
sarily assumed to occur with equal probability. The effects of alternate 
symbol inversion on this spectrum are also considered. The mathematical 
results are illustrated with many examples corresponding to optimal perform- 
ance codes. It is demonstrated that only for the case of a purely random input 
source (e.g., NRZ data with equiprobable symbols), and a particular class of 
codes, is the output spectrum identical to the input spectrum except for a 
frequency scaling (expansion) by the reciprocal of the code rate. In all other 
cases, the output spectrum is sufficiently changed relative to the input spec- 
trum that the commonly quoted statement "a convolutional encoder produces a 
bandwidth expansion by a factor equal to the reciprocal of the code rate" must 
be exercised with care. 
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I. 


Introduc tion 


While much attention has been paid toward constructing convolutional 
codes that achieve optimum error probability performance, very little attention, 
if any, has been paid toward examining the spectral properties of the corre- 
sponding encoder outputs. Perhaps the reason for this is that for most of the 
optimum performance codes found thus far, the output encoder spectrum, 

corresponding to a random NRZ input, is merely a frequency scaled version 

2 

of the input (sin x/x) spectrum. Stated another way, a purely random input 
gives a purely random output with a bandwidth expansion equal to the reciprocal 
of the code rate. 

In this report, we first examine the conditions (class of codes) for which 
the above is not a true statement. Indeed, it is shown that some of the optimum 
performance codes fall into this category. In these instances, the bandwidth 
expansion produced by the encoder can be considerably less than the reciprocal 
of the code rate, A discussion of the implications of this statement will be 
given in Section VII titled "Observations and Conclusions. " 

Following the above considerations, we determine the spectral character- 
istics of the convolutional encoder output when the input is not a purely random 
NRZ source. First, we generalize to the case where the input still has an NRZ 
format; however, the two signaling states of the binary waveform are not 
assumed to occur with equal probability, i. e. , a so-called unbalanced NRZ 
source. Since an unbalanced NRZ source has a symbol transition density which 
is less than 1/2, we next generalize to a first-order Markov input which allows 
symbol transition densities anywhere between 0 and 1. Finally, the effects of 
alternate symbol inversion on encoder output spectrum are considered. 
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We begin the report by noting that the symbol sequence at the output of a 
convolutional encoder is a cyclostationary process (Ref. 1) with period equal to 
the number of output interleaving taps. After defining the general model of a 
convolutional encoder, we then give a general expression for the spectrum of a 
cyclostationary process and show how it is applied to the convolutional encoder 
output sequence. From this point on, the report focuses on all of the special 
cases brought out in the above discussion. 

II. Convolutional Encoder Model 

Consider a convolutional encoder with constraint length K and rate b/n, 

as shown in Fig. 1. In the mth information interval, b information symbols 

a L,;l j =0,1,2,..., b- 1 enter the encoder and n channel symbols X , : 
mb+j J 1 mn+p 

p = 1,2,..., n exit the encoder. The structure of such a convolutional encoder 
can also be defined by a generator (connection) matrix, namely 


G = 


* 1.1 * 1.2 
g 2 , 1 g 2, 2 


g 1 , Kb 
g 2, Kb 


g n, 1 g n, 2 • 


• i • • • 


g 


n, Kb 


where g. . is either one or zero depending, respectively, on whether the ith 

i, J 

modulo summer is connected to the jth shift register stage. For mathematical 
convenience, we shall assume that both the input symbols anc * the out- 
put symbols take on values plus and minus one. This allows modulo 2 



Figure 1. A general constraint length K, rate b/n convolutional code 

summation operations to be replaced by algebraic products. Thus, the encoder 
of Fig. 1 has the input-output relation 


mn +p 


1 1 [ a (m+l)b~i] 


Clearly the output sequence is cyclostationary with period n. 








III. Spectrum of a Cyclo stationary Pulse Stream 


By definition (Ref, I), a sequence is cyclostationary with period n, if for 
any p and \ 

E {X , } a E {X } (2) 

1 mn+p J 1 p J ' ' 

and 


E {X , X , = E {XX 

1 mn+p mn+p+A J p p + A J 


m = 0, ±1 , ±2, 


(3) 


If, from the sequence {X^j, we form a synchronous data pulse stream 


OO 

m(t) = ^ X. p(t-iT) 

i=:-oo 


(4) 


where p(t) is the elementary signal (pulse shape), then the continuous component 
of the power spectral density of m(t) can be expressed in the form 
(Appendix A) 


S (f) = S (f) S (f) 
c p X 


where S^(f ) is a pulse shape factor defined by 


s p (f) = f |P(f) 


with P(f) the Fourier transform of p(t) and 


n 


J X 


(£ > = sE 

P =i 


X ~~ CO 


-v <v Vx) e ‘ j2rt£T 


(5) 


( 6 ) 


C7). 
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In (7), cov (Xp , X^^) is the covariance function of the sequence {X^} defined 
by 


cov (X , X ,.) = (X - X ) (X - X , J 

p p+A p p p+\ p+A 


and the over bar denotes expectation. 
Letting 


\ = n£ + q-p ; q = 1,2,. 
then we can rewrite equation (7) as 


n 


(8) 


(9) 


Wit t 


p=l q=l £~~cc 


V' COV (X X fi ) e -j2"(n^-p)fT 


"p, nll+q 


Eq. (10) will be more useful later, since it shows that X is the symbol 

P 

generated from the p interleaving tap output and is the symbol 

fch 

generated from the q interleaving tap output. 

From (2) and (3) we note that 

v p n£+q p-nf q 

Thus, using (11), we can rewrite (lOj'in the more compact form 


( 10 ) 


(ID 


n 

n 

oo 

£ 

£ 

£ 

p=i 

q-l 

o 

ii 


(12) 


6 



where is the Neumann factor defined by 

! 1 ; 11=0 

(13) 

2 ; otherwise 


We shall define the "memory" of the cyclostationary process as the smallest 
integer ft* such that cov (X^ ) = 0 for i >1*. 

If {X^} is not zero mean, then in addition to the continuous power spec- 
trum of (5), it will also have a discrete spectral component S^(f), which is 
given (Appendix A) as 


n 


S d <« - ( nT )2 




_ -j 

X. e 
l 




n 


k=-< 


i=l 



(14) 


which after some simplification can be reduced to 



(15) 
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IV. Encoder Output Spectrum for Independent Binary Symbol Input 


Consider the input to the encoder of Fig. 1 to be a sequence of independent 

binary symbols {a.} that take on values ±1 with probabilities 

3 


Pr {a. = -1} = 1 - Pr {a. = 1} = p* 
J J 


(16a) 


and average symbol value 

E {a.} = 1 - 2p* = a 


(16b) 


The transition probability which characterizes this sequence is then 

p t = 2p * (1 - p*) (17) 

Letting m = 0 in (1) with no loss in generality, then since for independent 
random variables, the expectation of their product equals the product of their 
expectations, we have 


X p = (5)°P = (1 - 2p*)°P ; p = 1, 2, 


n 


where 


Kb 


r P =5D *p.i 

i=i 


(18) 


(19) 
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i.e., the algebraic sum of the number of +l's in the pth row of G. Furthermore, 
it can be shown that 


a -to -2/3 a -to 

(a) P q Pq - (a) P q ; 0 < £ < K-l 


a+a-ZP i -2) a to 

C0V (V X n* + q) = ) m q P qP - (5) 9 P ; 

0 ; otherwise 


- (K-l) < £ < 0 


( 20 ) 


where 


(K-f)b 

= ^ g p, i g q, i+(!b 


( 21 ) 


i=l 


i.e., the cross correlation of the £th row-" of G with the'qth row shifted by 2 b 
elements. Finally, substituting (18) and (20) into (12) and (15) gives the desired 
results for the continuous and discrete components of the encoder output 
spectrum, namely 


V - it EE 4«" 

p=l q=l 2=0 


-to -2p ( 2 ) 

p q pq 


a -to "1 

- (i) p 


X cos [Zn (n2 + q - p) fTj 


, . /sin7rfT\^ 

s c« = T hiF- s x (f) 


( 22 ) 


* The cross correlation is performed only on the parts of the £th and shifted 
qth rows whose elements overlap. 
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and 



In (22) and (23), we have also assumed that p(t) is a unit rectangular pulse so 
that the shape factor of (6) is given by 

Sp W - T f (24) 

Note that the results in (22) and (23) are functions of only: (1) the a priori 
symbol probability p* [through a of (16)J and (2) the sums and cross con*ela- 
tions of the rows of the generator matrix G [through (19) and (21)J, 

Several interesting points can be deduced from (22). First, note from 
(19) and (21) that for p = q and 2 - 0, the exponent ^ 

independent of the code . Thus, for these terms 
,-kG -to -2/3 (2) . 

(a) p q pq l = 1 (25) 

for all a (including zero). It is also possible that the above exponent can be 
zero for other combinations of p, q, and 2, To see the class of codes for 


10 



which this can be true, we first rewrite the exponent in a different form. 
From (19) and (21) 


Kb 

a + a -2(3 (£) = (g . + g .) - 2 g . g 

p q pq La S p»i S q»i 7 La 8 p,i M q,i 

i=l i=l 


(K-f)b 


+£b 


Kb £b 

E g p,i + E R q,i 

i=(K-£)b+l i=l 


(K-f)b 


+ [ g p, i + g q, i+fb ~ 2g p, i g q, i+ib] 

i=l 


Kb 

E 

i=(K-£)b+l 


£b 


g . t- / g 

S p*i ^a & q, i 

i = l 


(K-f)b 

+ [ g p, i " g q, L + fb] 

i = l 


(26) 


The latter equality in (26) makes use of the fact that the elements of G are all 

either zero or one, i. e. , if x and y can only take on values zero and one, then 
2 

x+y-2xy = (x-y) '. 

Each of the three summations in (26) is non-negative. Thus, in order for 
(26) to equal zero, each of these summations must itself be zero. Moreover, 
since the elements in each of the sums are non-negative, then the sum can be 
zero only if each element in each sum is zero. Thus, in conclusion, the 


11 





Returning to (22), we further note that independent of the code, the 

a +a 

exponent is never equal to zero. Thus, the term (a) P q will be 

equal to one only when a is equal to one and will vanish when a is equal to 
zero (i, e. , p* = 1/2). This last statement is crucial to the results which 
now follow. 


A. The Case of a Purely Random Data Input (a = 0, p* = 1/2) 

Consider the special case of a random NRZ encoder input for which 
p* = 1/2 and correspondingly, from (16), a = 0. If the code is such that (27) is 
not satisfied for any combination of p, q, and SL (other than p = q and 2 = 0), then 
from the previous discussion, the only nonzero terms in (22) will be the n terms 
corresponding to p = q and 2 = 0 for which (25) applies. Thus, making use of 
(25) in (22) gives the simple result 


s x (f) = 1 


or 


(28) 



Furthermore, the discrete spectrum S^(f) of (23) vanishes. Thus, we reach 
the first important conclusion, namely, that for all codes which do not satisfy 
(27), a random NRZ data input results in a random NRZ data output scaled 
(expanded) in frequency by the reciprocal of the code rate, i.e,, n/b . We 
define this class of codes as "uncorrelated convolutional codes. 


'‘'Note, all rate 1/2, noncatastrophic c on volutional codes are uncorrelated 
c ode s , 
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If, on the other hand, the code is such that (27) can be satisfied for at 
least one combination of p, q, H (other than p = q and i = 0), then S-^(f) of (22) 
will be frequency dependent and the encoder output spectrum will not be merely 
a frequency scaled Version of the input. In fact, letting jp, q, i J denote the 
set of combinations of p, q, i (other than p = q and H = 0) for which (27) can be 
satisfied, then (22) simplifies to 


s x (f) = 1 + h - 2 2 2 e 2 cos C 27r < ni + q “ p) fT ] (30) 

{p» q> 2} 

Note that the discrete spectrum S^(f) of (23) still vanishes, since 
m = l,2,...,n; (i. e, , independent of the code, the output symbol sequence 
cannot have a discrete spectrum for a purely random input). 

We may now state the second important conclusion. Defining the class of 
codes which satisfy (27) (for at least one combination of p, q, l other than p = q 
and i = 0) as "correlated convolutional codes, 11 then we observe that for such 
codes the encoder output spectrum will differ (in form) from the input spectrum . 

At this point, it is instructive to give an example of a "correlated con- 
volutional code" and calculate its output spectrum for a random NRZ input. 
Clearly, from Fig. 2, any code whose generator matrix is such that two or 
more rows are identical satisfies (27) with 2 = 0 and is thus a correlated con- 
volutional code. In a recent paper by Larsen (Ref. 2), short constraint length 
(up to and including K = 14) noncatas trophic codes with maximal free distance 
for rates 1/2, 1/3, and 1/4 were investigated and tabulated. Indeed, for rate 
1/3 (n = 3), the tabulation includes only one correlated convolutional code 
which occurs for K = 3 (b = 1) and has the generator matrix 


G = 


1 0 1 
1 1 1 
1 1 1 


(31) 
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This code was first found by Odenwalder (Ref. 3). Since rows two and three of 
G are identical, we must evaluate (30) for the two combinations p = 2, q - 3, 

St = 0, and p = 3, q = 3, H = 0, Doing so results in the simple result 

S x ( f) = 1 +| cos 27rfT (32) 

Multiplying S v (f) of (32) by S (f) of (24) gives the encoder output spectrum 
A p 

S c (f) which is plotted in Fig. 3. 

For rate 1/4 (n = 4), the tabulation in Ref. 2 reveals three correlated 
convolutional codes corresponding to constraint lengths K = 3, 4, and 7, For 
the K = 3 code, for example, the free distance is ten (this is the maximum 
achievable), and the generator matrix is given by 

‘1 0 r 
1 1 1 

(33) 

1 
1 

J 

which is identical to (31) except for the addition of another identical row. Thus, 
following the same procedure as above, we find that 

S x (f) = 1 4 [2 cos 2?rfT + cos 4?rfT] (34> 

which together with (24) gives the output encoder spectrum illustrated in 
Fig. 4. 
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Code Generator Matrix 


1 0 1 
1 1 1 
1 1 1 



-4.00 -3.00 -2.00 -1.00 0.00 1.00 2.00 3.00 

fT 


Figure 3. Spectrum for Best Rate 1/3; Constraint Length 3 
Convolutional Code; Dotted Curve is Spectrum of NRZ 
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x/O) 


Code Generator Matrix 


1 0 1 
1 1 1 
1 1 1 
1 1 1 


I:::::::::;::::::::::::::::::::::::::::: 

ss9nnBB!»Ba 




0 . 00 , 
-4.00 


mn 

Mihiiiiiihihiiiii 

Ib8s5S5!5555SS5S8I!SSB Sk S!8B!« 

iiiBiiiianiniiniiim 

biaBS aansid 


-3.00 


• 2.00 - 1.00 


1.00 2.00 


Figure 4. Spectrum for Best Rate 1/4; Constraint Length 3 
Convolutional Code; Dotted Curve is Spectrum of NRZ 
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Another very interesting result may be gleaned from the simple examples 
just presented. Since codes whose generator matrix have at least two identical 
rows are a subclass of correlated convolutional codes for which H = 0, then for 
these codes (30) further simplifies to 

S^(f) 1 + - EE cos [2 tt (q - p) fT] (35) 

{p» q} 

where the set {p, q} now represents all pairs of integers corresponding to pairs 
of identical rows in G, Since (34) only depends on the difference q-p, and small 
values of q-p correspond, to less oscillatory behavior of S^(f), then it is clearly 
desirable from a spectral concentration standpoint to have the identical rows 
packed close together. For example, if the bottom row of G in (31) is moved to 
the top, then p - q = 2 and the spectrum S^(f) becomes 

S x (f) = 1 + | cos 4trfT (36) 

which is illustrated in Fig. 5. 

The important point to realize from the above is that permuting the rows 
of the generator matrix of a convolutional code can be used to change the encoder 
output spectrum without any effect on the bit error probability performance of 
the code . Further examples and extensions of this statement will be given 
along with the results that follow. 

B. The Case of an Unbalanced NRZ Input (a 4 0, p* 4 1/2) 

We now investigate, by example, the effect of unbalance in the probability 
distribution of the input on the encoder output spectrum. Consider first the 
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(f)/T 


Code Generator Matrix 


u 

C/5 


1 1 1 
1 0 1 



- i — i —t i *1 * i i i^i i >*» , i n i i i — i — i — i—j — i". i***' i i i i i i i i i 

-4.00 -3.00 -2.00 -1.00 0.00 1.00 2.00 3.00 4.00 

fT 


Figure 5. Spectrum for Best Rate 1/3, Constraint Length 3 

Convolutional Code 
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simple case of the optimum rate 1/2, constraint length 3 code whose generator 
matrix is given by 



0 1 ' 
1 1 


(37) 


For this code a, ~ 2, a n - 3 and the sets of exponents a + a and a 4*# 

12 p q p q 

- 2/3 (£); i- 0, 1, 2; p, q = 1,2 is tabulated below: 

pq 


l 

P 

q 

21 + q - p 

a + a 

p q 

a + a - 2(3 (2) 

p q pq 

0 

1 

l 

0 

4 

0 

0 

1 

2 

1 

5 

l 

0 

2 

1 

-1 

5 

i 

0 

2 

2 

0 

6 

0 

1 

1 

1 

2 

4 

4 

1 

1 

2 

3 

5 

3 

1 

2 

1 

1 

5 

3 

1 

2 

2 

2 

6 

2 

2 

1 

1 

4 

4 

2 

2 

1 

2 

5 

5 

3 

2 

2 

1 

3 

5 

3 

2 

2 

2 

4 

6 

4 


Using the results of (38) in (22) gives the closed form result 
S^(f) = 1 - ^ (a^ - a^) + (a + a^ - 2a^) cos 27rfT 

+ (a^ - a^) cos 4rrfT + 2 (a^ - a^) cos 6irfT 
+ (a^ - a^) cos 87rfT + (a^ - a^) cos 107rfT 


(38) 


(39) 
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Since this code is an uncorrelated convolutional code, (30) should reduce to 
S-^(f) = 1 for a = 0 which indeed it does. 

Figure 6 is an illustration of the continuous component of the encoder 
output spectrum S c (f) ^obtained by multiplying S^(f) of (39) by S^(f) of (24)J for 
various values of p* = (1 - a)/2, We observe that the spectrum becomes more 
and more concentrated as p* decreases. The continuous component of the input 
spectrum, on the other hand, remains unaltered in shape as p* is varied. In 
particular, for a unit power unbalanced NRZ input, the power spectral density 
is given by (Ref. 4) 

7 /sin7rfT,\^ 

S(f) = (1 - 2p*r 5(f) + 4p* (1 - p*) T b J (40) 

where T^ is the input bit time. 

The discrete component of the output spectrum S^(f) is easily found from 
(23) to be 


S d (f) = (a 3 - i 2 ) 


£ tt) ! * (< ■ - A) 


(41) 


k=l, 3, 5. , , 


As a second example, consider the optimum rate 1/2, constraint length 
7 code whose generator matrix is given by (Ref. 3,5) 


G = 


'11110 0 1 
10 110 1 1 


(42) 
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(f)/T 


Code Generator Matrix 

1 0 1 

111 



fT 


Figure 6a. Spectrum for Best Rate 1/2, Constraint Length 3 
Convolutional Code; p* =0.1 
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I/O) 



fT 

Figure 6b. Spectrum for Best Rate 1/2, Constraint Length 3 
Convolutional Code; p* = 0. 3 
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(f)/T 


1.0 



- 4.0 - 3.0 - 2.0 - 1.0 0.0 1.0 2.0 3.0 * 4.0 


fT 


Figure 6c. Spectrum for Best Rate 1/2, Constraint Length 3 
Convolutional Code; p# = 0,5 
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Since for this code = 5, then because of this balance in the number of 

ones in both rows of the matrix, we immediately see from (23) that the encoder 
output will only contain a discrete spectrum at fi = 0, i. e. , S^(f ) = (a) 6 (f)*. 

The continuous component of the output spectrum can once again be obtained 
from (22) where S^{£) is now given by 

S^(f) = 1 - a 1 ^ + (a 2 + a^ - a*°) cos 2rfT + (a 4 + - 2a 10 ) cos 47rfT 

+ 2 (a^ - a^) cos 67rfT + 2 (a^ - a^) [cos 87rfT + cos 147rfTj 
+ (a^ + a^ - 2a^) cos 107rfT + (a^ + a^ - 2a^) cos 127rfT 
+ 2 (a 8 - 5 10 ) j^cos l67rfT + cos 207rfT cos ZZiriT 

+ cos 247rfT + ^ cos 267rfTj + (a^ + a^ - 2a^) cos lSufT 

(43) 

Figure 7 is an illustration of the corresponding continuous spectrum S c (f) for 
several values of p* = (1 - a)/2. As before, we observe that the output encoder 
spectrum narrows as p* is decreased. 

An interesting thing now happens if, for example, we reverse the direction 
of the sampler (commutator) at the output of the encoder. This is equivalent to 
interchanging the two rows in the G matrix of (42). Since the two rows still 
contain the identical number of ones, i. e. , = 5, then the discrete 


*For any code with ni ~ do - . . . a m = n, Eq. (23) will simplify to 
S d (f) =(a)"«(f). " " 
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Figure 7a. Spectrum for Best Rate 1/2, Constraint Length 7 
Convolutional Code; p* = 0. 1 
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Figure 7c. Spectrum for Best Rate 1/2, Constraint Length 7 
Convolutional Code; p* =0.3 
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spectral component of the encoder output is unchanged. However, the continuous 
component of the encoder output spectrum is not characterized by (43) but 
rather by 

S x (f) = 1 - + (a^ -fa 4 - 2a*^) cos 27TfT 

+ (a 4 + a 6 - 25 10 ) [cos 4jrfT + cos lOirfT + cos 127TfT] 

+ (a^ + a^ - 2a^) [cos 6iTfT + cos 227rfT] 

+ 2 (i 6 - i 10 ) £cos 8-rrfT +| cos 18iTfT 

+ (a 4 + a^ - 2a^) cos l4irfT 
+ 2 (a^ - a^) J^cos 16n£T + cos 20nfT 
+ cos 247rfT cos 26TtfT 

(44) 

The corresponding continuous spectrum component S c (£) is illustrated in Fig. 8 
for the same values of p* as in Fig, 7, Comparing these two figures, it is 
difficult to draw any decisive conclusions regarding their relative spectral 
width other than to note that the two spectra are quite different. 

We conclude this section by noting that reversing the sampler for the 
rate 1/2, constraint length 3 code characterized by G of (37) would not alter the 
spectrum. The reason for this conclusion is that the two rows of G have even 
symmetry about their midpoint (i.e. , the elements in column 2). This is not 
true for the generator matrix of (42) and it is indeed this lack of even symmetry 
which makes the encoder output spectrum dependent on the sampler direction. 
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Figure 8a. Spectrum for Best Rate 1/2, Constraint Length 7 
Convolutional Code; Sampler Reversed; p* = 0.1 
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(f)/T 







fT 

Figure 8b. Spectrum for Best Rate 1/2, Constraint Length 7 
Convolutional Code; Sampler Reversed; p* = 0.2 
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Figure 8c. Spectrum for Best Rate 1/2, Constraint Length 7 
Convolutional Code; Sampler Reversed; p* = 0.3 
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V. Encoder Output Spectrum for First Order Markov Input 

For the first order Markov case, we first transform the information bit 

sequence {a.} into a transition sequence {t.}, where t. = a. a. j « 1,2, ,,, 

J J 1 J J 

The sequence {t.} is a stationary sequence of independent random variables 
with 


Pr {t. = -1} = 1 - Pr {t. = 1} = p fc 


E {t.} =: 1 - 2p t # t 


(45) 


where p. is the transition density. For any i and n > 1 we have 


n 


l £-n = a £ J" , Vi+1 

i=. 


(46 a) 


n 


a £+n = a f Y t ^ 
i=. 


(46b) 


Recalling from (1) that for m = 0, 


Kb 




(47) 


i=l 


then, substituting (46a) with £ = b - 1 into (47) results after simplification in 


isl 


( 48 ) 
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where 


Kb 


- .-T B . 

p. i p»J 


(49) 




Note that ^ of (19). Since the elements of the sequences { a j} an£ l {tj} 

can only take on values ±1, then the algebraic sum of (49) can be replaced by 
a modulo 2 sum. Defining 


Kb 


>» i ~ S p» j 


(50) 


J=i 


then (48) can be equivalently written as 


Kb-1 


vM hp>i n (u p,i+i 


(51) 


i=l 


where & denotes modulo 2 summation. Note that (50) defines a ''modified 
generator matrix" H with (0, 1) elements which is uniquely related to the connec- 
tion matrix G. In fact, each element in H is merely the modulo 2 sum of the 
corresponding element in G with those in the remainder of that row. Using 
(46b) we can similarly write 


£b 


Kb-1 


X n£+q = ( a b-l) ^ 1 H N-l+j) ^ 1 FI W)b-i 


(52) 


i-1 
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To evaluate the encoder output spectrum factor S^(f) of (12), we require 
the covariance of X^ of (51) and X^^ of (52). To compute this covariance we 
first define 


Kb 


i=2 


(53) 


Then, from (51), 


Pr 


x = (l - h ) (t)' p 

P P» 1 


(54) 


and 


X X 
P 


® h q.l)] 


- Vp qM) 
(t) P> q 


(55) 


where for 1 < 2 < K-l 


0b+l 


Kb 


r 


p» 


q W S (Vl ® \.i) + E ( h q, 1+1 @ h p. i-lb+l) 

i=2 i=£b+2 


Kb 


i=(K-f)b-hl 


h 

p» i 


(56) 


The result in (56) can be simplified by noting that for x and y both (0, 1) 
variables, 


x © y = x + y - 2xy 


(57) 
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Thus* 


Y p.q W=P P +P q- 2{ p.q (i,: 1 ^ S K - 1 


(58) 


where 


(K-f|b / ^ > 

| (0 = Y' h . h .^-^h , |2 + ib - 2 Yj h . 

S P»q Zj p< i q, l+fib 2 q, 1 \ q, l 

i=2 \ i=l ) 


(59) 


The relation in (58) can also be shown to hold for 2 = 0 and 2 > K in which case 


Kb 


h p, i h q, i ’ 


i=2 


W £) a 


l = 0 


k-Hv ! £> - K 


(60) 


Thus, using (54), (55), (57) and (58) and recognizing analogous symmetry- 
properties for 2 < 0 as used in obtaining (20), the desired covariance is given by 


f 1 - h , - h , + 2h , h . 1 
I p» l q» l p. 1 q» 1J 


p + p - 2£ (£) 

ft) p *q P,q 


COV ( X p X n«+q) = 


fl - h 

L p» 


- (1 *■ h p ^ j) (t) Pp Pq ; i > o 


- h , + 2h , h , "I 
>» 1 q» 1J 


- - II , T Ul 1 

1 q» A p, 


p +p -21 (-f) 

(t) q P q * p 


/ V - P a + Pn 

- (‘ - h p, l) (t) P ’ 


( 61 ) 
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Note the similarity in form between (20) and (61). The prinicpal difference 
between the two is that (20) corresponds to a cyclo stationary process with 
memory equal to K-l whereas the memory of the process characterized by 
(61) is infinite. 

Finally, substituting (61) into (12) and performing considerable simplifi- 
cation gives the desired result, analogous to (22), namely, 


n n 


K-l 


s * (£) = eL £ t 1 - h P . i - v i + 2h P . i h q , i) £ 

p=i q=i 




X 


- Pn + P a " 2 ^P» . P D •+ P n 

(t) P q “ (l-h q l )(t) P q 


Xcos [2?r (n l + q - p) fT] 


n n 




n +n + Kb 

(i) p q 


p=i q =1 


cos £2 tt (nK + q - p) fT] - t^ cos [] 2 tt (n (K-l) + q - p) fT] 


1 - 2 t* 3 cos 27rnfT + t 2 ^ 


S c ( f ) = T £ x (f) 


(62) 
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The discrete spectrum S^(f) at die encoder output is obtained by 

substituting X of (54) into (15). Thus* 

P 




Note that a discrete spectrum can potentially exist at the encoder output despite 
the fact that the encoder input has only a continuous spectrum. In fact, for a 
first order Markov source as the encoder input, its spectrum is given by 
(Appendix A) 


S(f) = 


1 


-2 

t 


1 + t - 2t cos EirfT, 


^sin TrfTj 
TrfT, 


(64) 


where is again the input bit time (see Fig, 9). Note that if the code is 
transparent , i. e. , each row of G has an odd number of ones, then from (50) 

hp, . = 1 ; p = 1, 2, . . . . , n (65) 

which when substituted in (63) results in S^(f) = 0, 
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As an example of the application of (62), consider the rate 1/2 constraint 
length 3 convolutional code described by the generator matrix of (37). The 
modified generator matrix H as defined by (50) is then 



1 r 
0 1 


( 66 ) 


The corresponding continuous component of the encoder output spectrum may be 
obtained from the following closed form solution for S^(f), namely 

s x (f) = 1 - \ t 4 


+ 


-t 3 (1 + t - t 2 ) + t 2 (1 ,+ t 3 - t 4 ) cos 4TTfT + t 2 (1 


t - t 3 + t 3 ) COS 87TfT 


1 - 2t cos 4itfT + t 


7T 


(67) 


Fig. 10 is an illustration of (f) [using (67) ^ for several values of transition 
density p^_ = (1 - t)/2. Note the unorthodox behavior of this spectrum in 
accordance with the similar behavior of that corresponding to the encoder input 
bit stream (Fig. 9). 

VI. Encoder Output Spectrum in the Presence of Alternate Symbol Inversion 
Alternate symbol inversion (Ref. 5) is a technique in which alternate 
symbols of the encoder output are inverted to provide the sufficient richness of 
symbol transitions necessary for adequate symbol synchronizer performance. 

In this section, we examine the effects of such a nonlinear operation on the 
power spectrum of the convolutional encoder output. 
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Figure 10b. Spectrum for Best Rate 1/2, Constraint Length 3 
Convolutional Code; First Order Markov Source Input; p t = 0. 3 
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Figure 10c. Spectrum for Best Rate 1/2, Constraint Length 3 
Convolutional Code; First Order Markov Source Input; p = 0. 7 
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Figure lOd. Spectrum for Best Rate 1/2, Constraint Length 3 
Convolutional Code; First Order Markov Source Input; p t = 0.9 
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If the number of interleaving tap outputs is an even number, we can 
simply put inverters at alternate interleaving taps*, in which case the general 
equation (12) for S-^(f) should be modified to read 


n n oo 

S X (£ > = S S ( ‘ 1,P+q cov ( v X n£+q* COS [ 27F + q " P) fT ] 

p=l q=l 2=0 

( 68 ) 


Similarly, for computation of the discrete component of the encoder output 
spectrum, Sj(f) of (15) remains valid with,however, X of (18) and (54), 
respectively, modified as follows: 

X = (-l) p 5* p (69) 

r 

and 

V'- 1 )P (i- h P .i) Jpp (70) 


If the number of interleaving tap outputs is an odd number, we cannot put 
fixed inverters on alternating tap outputs. Instead, we can look at the alternate 
symbol inverted output as having been obtained by adding (modulo 2) an external 
alternating binary sequence of ones and zeros to the encoder (0, 1) output 
sequence. An equivalent procedure, which is more convenient for computation 
of the power spectrum is described as follows. Given a constraint length K, 
rate b/n convolutional code with n odd and generator matrix coefficients 
{g . } ; p = 1, 2, . . . , n, i = 1, 2, . . . , Kb, we can, without any loss in 


^Without any loss of generality, we assume that the first symbol inverter 
appears on the first tap output. 
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optimality or any change in transmission rate, construct an equivalent code with 
constraint length K and rate 2b /2n whose 2n x 2Kb generator matrix has 
coefficients {g* given by 


g* : 
P» J 


g 


g 



P = b + 1 

p- b » j 5 

j = 1 , 2 , 


p = 1 , 2, 

p. j-n ; 

j = n + 1 

0 ; 

elsewhere 


b + 2 , . . , 
i • • . , n 
. ...» Kb 
n + 2* . . . 


. i (K + l)b 


. i 2n 


(71) 


Fig. 11 is an illustration of this procedure for bsl, K = 3. Now, since the 

number of output taps (2n) is even, we can once again use fixed alternating 

symbol inverters on these taps and the general results of (68), (69), and (70) 

apply with n replaced by 2n, b replaced by 2b, g . replaced by g* and 

p, i r p* i 

using (50) hp ^ replaced by h* 

Before presenting a specific example, we can once again make some 
general statements for the various input source models previously considered. 
When the input is a purely random sequence, then as before the only terms 
which contribute to the summations in (68) are those for which p = q and i = 0. 
Since for these terms {-l) p+q = 1, then (68) reduces to (12) which for this 
special case gives the result in (28). Thus, for the class of uncorrelated 
convolutional codes, alternate symbol inversion has no effect on the encoder 
output spectrum . This is intuitively pleasing since one would expect that adding 
an alternating sequence to a purely random sequence (the encoder output before 
alternate symbol inversion) should produce again a random sequence. 
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Figure 11a, An Optimum Convolutional Encoder with b = 1, n = 3, and K = 3 



Figure lib. An Equivalent Encoder with b a 2, n = 6, and K = 3 


51 





For correlated convolutional codes alternate symbol inversion will, in 
general, have a spreading effect on the output spectrum. If, however, we again 
consider the subclass whose generator matrix has at least two identical rows, 
and if the identical rows are spaced such that p+q is always even , then alternate 
symbol inversion will not affect the encoder output spectrum. 

To demon strati, the spectrum spreading effect of alternate symbol 
inversion, consider the rate 1/4 code described by the generator matrix in 
(33). When alternate symbol inversion is employed and the input is a random 
NRZ sequence, (34) is modified to 

S x (f) = 1 + “• [-2 cos 27TfT + cos 47rfT] (72) 

and the corresponding output spectrum is illustrated in Figure 12. This figure 
should be compared to Figure 4 which characterizes tire same encoder output 
without alternate symbol inversion. 

Ano tlier illustration of the effect appears in Figures 13a and 13b where 
the optimum K - 7 rate 1/2 code is employed with an unbalanced NRZ input 
having p* = 0.2. Figure 13a is essentially a duplication of Figure 7b with, 
however, the discrete component of the output spectrum superimposed. Simi- 
larly* Figure 13b has the discrete spectrum superimposed. Notice how alter- 
nate symbol inversion not only spreads the spectrum but also creates many 
new significant discrete spectral harmonics. 
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Figure 12. Spectrum for Best Rate 1/4, Constraint Length 3 
Convolutional Code; (Alternate Symbol Inversion) 
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(f ) / (TS ) and S,(f)/S 
c d 

max 


Code Generator Matrix 


10 110 11 
11110 0 1 



fT 

Figure 13a. Output Spectrum of the Code With 
Unbalanced NRZ Input; 
p*=0.2;S = 2. 398;S d =0.006 

max max 
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(f ) / (TS ) and SjCO/S 


Code Generator Matrix 
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Figure 13b. Output Spectrum of the Code with Unbalanced NRZ Input; 

(Alternate Symbol Inversion) 

p*=0.2;S c = 0. 985; S d =0.002 

max max 
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VII. Experimental Results 

To support the analytical results derived in this report, an optimum 
constraint length 3, rate 1/4 convolutional encoder was implemented, and its 
output spectrum was observed on a spectrum analyzer in response to a PN 
sequence at its input. Analytical results contained in this report [see (33) and 
(34)] have shown that this code belongs to the class of correlated convolutional 
codes and thus one would expect an output spectrum which differed from a fre- 
quency scaled version of the input spectrum [see Figure 4], Indeed this result 
is confirmed by the experimental results illustrated in Figure 14 (logarithmic 
scale) and Figure 15 (linear scale). Unlike a rate 1 /4 uncorrelated convolu- 
tional code whose 3 dB bandwidth of the output spectrum is four times the 3 dB 
bandwidth of its input, the 3 dB bandwidth of the output spectrum of this best 
constraint length 3, rate 1/4 code is less than one and one-half times the 3 dB 
bandwidth of its input. 

VIII. Observations and Conclusions 

We have observed that there exists a class of convolutional codes 
(designated correlated convolutional codes ) which have the property that a 
purely random input results in an encoder output sequence with correlated 
symbols. When the power spectrum of the waveform produced by this cor- 
related output sequence is computed, it is observed that its effective band- 
width is narrower than that produced by an uncorrelated (purely random) 
sequence. An equivalent statement is that the power spectrum of the output 
waveform corresponding to the entire (doubly infinite) sequence is narrower 
than that for the individual pulse , the latter being identical to the power 
spectrum of an equivalent pulse stream with uncorrelated symbols. 
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Figure 15. Experimental Measurement of Input and Output Spectra for Best 
Rate 1/4, Constraint length 3, Convolutional Code (Linear Scale) 
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Based upon the above, one might hasten to conclude that to achieve a 
given error probability performance, it might be possible to go to a short 
constraint length, high rate code (less complexity) without having to pay the 
bandwidth expansion penalty ordinarily associated with this choice. Unfor- 
tunately, this is not the case. The reason is that the transmit filter and 
channel bandwidths are determined by' the need to pass an individual pulse with 
minimum distortion; this is necessary for adequate symbol sync performance 
in the receiver prior to decoding. Indeed, the bandwidth of the power spectrum 
corresponding to an individual output symbol pulse expands directly as the 
reciprocal of the code rate. Thus, the correlation of the output symbols is not 
effective in reducing the channel bandwidth requirements. However, portions 
of the receiver, e.g., the carrier tracking loop, whose performance depends 
on the bandwidth occupancy of the entire modulation (as opposed to that of an 
individual pulse) can be aided by employing correlated convolutional codes. 

For example, if the transmission is suppressed carrier and the carrier recon- 
struction loop is a Costas loop, then a reduction in the bandwidth of the modula- 
tion enables one to design narrower arm filters thereby improving the loop's 
squaring loss (tracking threshold) performance. An example of this point is 
illustrated by the results of Figure 16 where a Costas loop with single pole RC 
arm filters has been assumed. The corresponding analysis which generated the 
curves in this figure is contained in Appendix B. 

Before leaving this subject, we remind the reader that if alternate 
symbol inversion is employed to improve the encoder output symbol transition 

density, then this acts in such a way as to once again expand bandwidth and the 
above spectral advantage associated with correlated convolutional codes tends 
to disappear. 
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Figure 16. Squaring Loss versus the Ratio of 3 dB Cutoff Frequency to Data 
(Symbol) Rate; Detection Symbol Signal -to-Noise Ratio ST/N^ = -4 dB 
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APPENDIX A 


THE COMPUTATION OF POWER SPECTRAL DENSITY 
FOR SYNCHRONOUS DATA PULSE STREAMS 


Introduc tion 

Many techniques appear in the literature and some textbooks for the 
computation of the power spectral density of a synchronous data pulse stream 
where the underlying data sequence which generates the pulse stream has 
known statistical properties. In all cases found by the author thus far, the 
sequence is assumed to be either wide sense stationary (WSS) with known auto- 
correlation function or more generally an N-ary Markov source with known 
(fixed) stationary and transition probabilities, A special case of the latter is 
a purely random source, i. e. , one that emits an elementary signal (pulse) in 
a given signaling interval independent of those emitted in previous signaling 
intervals. Such a source can be modeled as a degenerate case of an N-ary 
Markov source whose NXN transition matrix (the matrix of transition 
probabilities) has identical rows. When N = 2, and the two elementary signals 
are the same, we get the familiar results for antipodal binary signaling. 

Occasionally, one finds situations where the generating data sequence is 
not WSS but, however, is cyclostationary, i. e, , its first two moments are 
periodic. One such case occurs at the output of a convolutional encoder where 
the period (in code symbols) is equal to the reciprocal of the code rate. Thus, 
in order to characterize the spectral properties of the output of such an encoder, 
one must develop an expression for the power spectral density of a synchronous 
data stream whose generating sequence is cyclo stationary. Such is the primary 
purpose of this appendix. As a review and an introduction to the technique, we 
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shall first present the derivation of the known result for the power spectral 
density of a synchronous data stream generated by a binary WSS sequence. 

Power Spectral Density of a Synchronous Data Stream Generated by a Binary, 
Zero Mean, WSS Sequence 

Consider the binary (±1) zero mean, WSS sequence a n for which it is 
known that 



a a = R (m - n) 
n m 

(A- 1) 

and the overbar denotes statistical expectation. From this sequence, we form 
the synchronous dat? pulse stream 

OO 

m(t) = ^ ] a Q p (t - nT) (A-2) 

n=-oo 

where p (t) is the elementary signal (pulse shape) and is not necessarily 
restricted to be time-limited to only a single signaling interval, i. e. , the 
pulse train m (t) can contain overlapping pulses. Irrespective of the properties 
of the generating sequence {a n }, the data stream m (t) is itself cyclostationary 
since the expected value of the product m (t) m (t + t) is, in addition to being a 
function of T, a periodic function of t. Thus, to compute the power spectral 



over t [the averaging is performed over the period of R (t ; t)] and then take 
the Fourier transform of the result. Thus, 

S m (f) “ <R (t 1 T)> 1 (A-4) 

where < > denotes time average and &T denotes Fourier transform. Substituting 
(A-2) into (A-3) and making use of (A-l) and the definition of Fourier transform, 
we get* 

S m (f) = ^ ^ ^ 1 R (m - n) p (t - nT) p (t + r - mT) e "j 2lTfr d t 

t n m 

(A-5) 


Since 



(A-6) 


where P (f ) is the Fourier transform of p (t), then substituting (A-6) in (A-5} 
gives 


S m< f > = / /E I] R(m ' n) P(y) P * ( z > e ‘ j2,,ynT 

y z n m 

X e j2l,zmT <y 2lt(5r - z,t > r e -i^{i^)r dT dy dz 

T 

(A-7) 


^Unless otherwise noted, all summations and integrals range from -oo to «. 
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(A-8) 


where the asterisk denotes complex conjugate. Recalling that 


J' e "J 27TXT dr = <5 (x) 


then (A-7) simplifies to 

S m (f) = / (m-n) P(y)P* (.£) e-j 2,Ty “ T e -j 2,rfmT ^ j 2 ^<Y +f ) t ) dy 

y n m 


= f ^ X) R <m ' n) P<V) P * (_f) e-i 2lTt(m - n)T e'jR’ffy+DnT 

y n m 

x< / e j2ir(y«)t' >dy 

<A-9) 

Since R (t ; t) is periodic in t with period T, then 


T 

/ J2TT(y+£)tx 41 f 2 J2ir(y«)t _ aln t " (y + f) T ] 
\ / ~ T J e dt ' 71 (y + £) T 

-T 

2 


(A- 10) 


Substituting (A- 10) in (A- 9) and letting 2 = m - n, gives 


; m (f) = 23 R (e) e ~ iZl,UT I p(y > p * <- f) si Vw Y + + ti\ 


X 23 e-^y H)nT dy 


(A- 11) 


n 
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Finally, from Poisson's sum formula, we have that 




which when substituted in (A-ll) yields 


S (f) = 
m 


£ R «« T E 


P(-f + ~) P* (-f) ■— ^ Tr - 


Since 


sin Trk 
Trk 


| 1 ; k = 0 

( 0 ; otherwise 


and |p (f)| is an even function of f, we get the desired result 


S (f) = S (f) S (f) 
m p' a 


where 


S (f) = i |p (£)| 

r 


is the power spectral density of the individual pulse p (t) and 


S a (f) = R (f) e "j 27Tf ^ T 


£=-00 


A- 1 7) 
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is the spectral density of the sequence, i.e., the discrete Fourier transform of 
its correlation function. Note that if the data sequence is purely random, i.e.. 


1 ; m = n 

0 ; otherwise 

then equivalently from (A-l) 


a a = 
n m 


(A-18) 


R (2) = 


i ; 
0 ; 


= 0 

otherwise 


and from (A- 17), 


S a (f) = 1 

Hence, 

S(f) = S (f) 

which is a commonly used result. 


(A-19) 


(A-20) 


(A-2 1) 


Power Spectral Density of a Synchronous Data Stream Generated by a Binary, 
Zero Mean , Cyclostationary Sequence 

Suppose now that we have a binary sequence {a^} which has the properties 

a~ = 0 
n 

a a = R (n ; m - n) 
n m 

(A-22) 
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Furthermore, 


R (n ; m - n) = R (n + kN ; m - n) ; k - = 0, ±1, ±2, ... (A-23) 

where N denotes the period of the correlation function R (n ; m - n). Then, 
following the steps leading up to (A-9), we see that the analogous result is now 


S m (f) = f £3 R (n ; m ' n) P<y)P< ' ( ' £) e' j2l,f(m ' n,T 

y n m 

x< y2,r( y +f)t^ dy 

(A-24) 


Thus far, we have not made use of the cyclostationary property given in 
(A-23). If now we use this property to evaluate the sum on n in (A-24), and 
as before let l = m - n, then it can be easily shown that 


23 R (n -A) e -j 2 ,r <y +f > nT = 


n 


:N 


23 R (n i l) e'j 2w <y«> nT 


n=l 


X > e 


-j27T(y+f)kNT 


or making use of (A -12), 


(A-25) 


23 R < n '-V 


.j2?r(y+f)nT 


n 


N 


^ R (n ; £) e" J 


j2tt(y+f)nT 


n=l 


NT 6 ( y + f " Nt) (A-26) 

k 
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1 

1 


Substituting (A-26) in (A-24) and performing the integration on y gives 


S m (f > 


N 


Y. R (n ; H) e’j 2Trnk/N 


-j2nf£T 


k l 


n=l 


X P(-f + P* (-f) <(e j2,rkt/NT ^> 

(A-27) 


Since R (t ; r) is now periodic in t with period NT , then 


<■ 


j2trkt /NT 


> 



j2-rrkt/NT 


dt = 


sin TTk 
TTk 


1 ; k = 0 

0 ; k t 0 


Finally, substituting (A-28) into (A-27) gives the desired result 


S (f) = S (f) S-(f) 
m p a 


where S (f) is still given by (A-16) and S— (f ) is defined by 
P 3- 


oo 

r n i 


r""> 

s-(f) = 2^ 

r ]C r <n = *> 

e -j27TffT 

H— - 00 

n=l 






(A-28) 


(A-29) 


(A-30) 
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Comparing (A-30) with (A-17) we notice, not surprisingly, that the only 
difference between the two is that the periodicity of the correlation function 
caused by the cyclostationary behavior of the sequence {a n } must be 
"averaged out" before taking the discrete Fourier transform. 

Power Spectral Density of a Synchronous Data Stream Generated by a Binary, 
Nonzero Mean, Cyclostationary Sequence 

When the generating sequence {a- n } is not zero mean, then the spectrum 
of the corresponding synchronous data stream will have a discrete component 
in addition to the customary continuous component. An example of a situation 
where this might occur is at the output of a convolutional encoder whose input 
is random but not equiprobable binary data. The procedure for handling this 
case is as follows: 

Define the zero mean cyclostationary sequence {A^} by 

A = a - 5 ( A — 3 1 ) 

n n n 

which has the properties 


A = 0 
n 


A n A m = R A (n ! m - n) 


(A-32) 
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Then, using the results of the previous section, the continuous component of 


the power spectrum S (f) for a synchronous data stream generated by {a } is 
given by 


S (f) = S (f) S— (f) 
c p A 


where again 


(f) is defined in (A-16) and 


(A-33) 


oo 

r N 1 


s a<« = £ 

N R A ; ^ 

e -j27iffT 

f = -0O 

n=l 






(A-34) 


The discrete spectral component S (f) is found from 


s d (f) = ^{<22^ (t “ nT) p (t + r ‘ mT) >| (A_35) 


n m 


Making use of the Fourier transform relation of (A-6) gives the alternate form 


s d (f) = 


1 2-/ ILj a n e "^ 277ynT a m e"j 2Tr£mT P(y) P* (f) <^ e j Z7r ^ y+f ^^> dy 
y n m 


(A-36) 
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Since by assumption a_ and 
to (A-26) 


n a m are both Periodic with period N, then analog 


ous 


— e -j2TTynT 
n 


n 


N 


n=l 


r - e -j27rynT 

n 


NT S 6 ( y - th) 


— e j2ffmT 
m 


m 


N 


m=l 


a e 
m 


-j2TTymT 


nt 6 ( £ - fir) 


(A-37) 


Substituting (A-37) in (A-36) and integrating on y yields after simplification 


S d (f) = NT 6 ( £ ' N?) 2 a m e " J 

k m=l 


j27Tmk/N 


xl V 
NT Z-r 

i 


, \ N 

P (i4) P * (- e^ 2 ™^ N <y 2 *< k+i! > t/NT > 

n=l 


<A-38) 


Performing the time average over the period NT gives as before 


<' 


s j2TT(k+f )t/NT 


\ _ sin 7r(k + g ) 

/ Tr(k -f £) 


1 ; * = -k 

0 ; otherwise 


(A-39) 
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is an even 


Finally, substituting (A-39) into (A-38), and recalling that |p(f)j ^ 
function of f, gives the desired result 



(A-40) 

Note that when |a n | is a WSS sequences (i. e. , N = 1), (A-40) reduces to the 
familiar result 

s a< f > = ~r £ | p (l )| 2 8 ( f ■ 7) < A - 41 > 

1 k ' 

Examples and Applications 

As a simple example of a WSS sequence consider a binary, zero mean 
Markov source characterized by 

Pr j a n+t * a n) = p t 
Pr ( a nH = a n| ' ‘‘Pt 

(A-42) 
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The correlation function for such a source is easily shown to be 


R (£) = (1 - 2p t )’ £! 

Substituting (A-43) into (A-17) gives 

OO 

S a (f) = 1+2 ^1 - 2p^ cos 27rffT 

£=1 


From £6; p. 84, Eq. (454)], we have that 


£ 


k 

a 


a cos 9 - a 


2 


cos k fl = 


+ a. n ^ cos (n0) - a 11 ** cos[( 

~ — : 7” — 2 

1 - 2a cos ( n6 ) + a 


which for a< 1 and n-»« becomes 


£ 

k=i 


a cos k 9 - 


a cos 9 - a 
1 - 2a cos 9 + af 


Furthermore, 


1+2 



k 

a 


cos k 9 = 



2 

1 - 2a cos 9 + a 


(A-43) 


(A-44) 


n + 1)0] 


(A-45) 


(A-46) 


(A-47) 
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Applying (A-47) to (A-44) with a = 1 -2p^ and d = 2it£T $ immediately gives the 
desired result 


1 . (i . 2Pt ) 2 

s AD = ; 

1 + (1 . 2p t )‘ -2 (l - 2p t ) cos 2irfT 

= 4 P t i 1 ' P t ) 

2 ^1 - 2 p^j (1 - cos 27rfT) + 4p fc 2 


(A-48) 

Furthermore, if the data stream generated by this sequence uses rectangular 
pulses, i. e. 



0 < t < T 
otherwise 


(A-49) 


then, using (A-16) and (A-48) 


2 

~ sin 7TfT 

4 P t a - p t ) I 

olij - I ? 

(7rfT) 

2 (1 - 2p t ) (1 - cos 27rfT) 4p fc 2 


(A-50) 


This result has previously been obtained by the author using the more complex 
approach found in (Ref. 4; Chap. 1) and also by others (Ref. 7). 
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As a second example, consider the sequence formed by interleaving N 

independent first order Markov sources with respective transition 

probabilities p fc ; n = 1 , 2, .... Then, the resulting sequence is 
n 

cyclostationary with correlation function 


!li 

N 


R (n ; l) =i 


f - z \) " ! 


i = 0, ±N, ±2N, .... 


0 ; all other integer l 


(A-51) 


The power spectral density S-(f) of (A-30) is computed as (letting i - kN, 
k = 0, ±1, ±2, . . , .) 


N 


S-(f) = 
a 


2 \) 

n~l k ' n/ 


|k| -j27rfkNT 


N 


= N L T +2 Ti ( A ' 2 P t ) kcos 27rfkNT 


n=l 


k=l 


(A-52) 


Noticing the similarity between (A-44) and (A-52) (for fixed n), we can 
immediately write down the result 


N 


S a (£ > - i? L 


n=I 


4 P t ( £ ' Pt ) 

n \ n / 


2 ^1 - 2p t J (1 - cos 2irfNT) + 4p fc 


(A-53) 
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APPENDIX B 


COSTAS LOOP TRACKING PERFORMANCE FOR A CONVOLUTIONALLY 
ENCODED SUPPRESSED CARRIER INPUT MODULATION 


In this appendix, we derive the tracking performance of a Costas loop 
demodulator of a suppressed carrier input where the modulation is a random 
pulse stream with convolutionally encoded symbols. In particular, a closed 
form expression will be obtained for mean-square tracking jitter (or equiva- 
lently loop squaring loss) corresponding to the case where the loop arm filters 
are of the single pole RC type, and the data modulation is generated by the opti 
mum rate l/4, constraint length 3 correlated convolutional code [ see (33)]. 

Without going into great detail, it is well known [8] that for a random 
pulse train [such as that characterized by (A-2)] plus additive white Gaussian 

noise input to a Costas loop, its (linear region) mean-square phase tracking 
2 

jitter cr 2 ^ is characterized by the expression 



(B — 1 ) 


where* p = S/N B is the equivalent linear loop signal -to -noise ratio and 

U J— ; jLj 

is the so-called "squaring loss" which is a degrading factor caused by the 


multiplication of in-phase and quadrature signal plus noise terms in the loop's 
third multiplier. More specifically, the squaring loss factor depends on the 
input modulation power spectrum S m (f) and the arm filter transfer function 
G(j 2rrf) through the relationship 


Here, S denotes the average signal power, No denotes the single -sided noise 
spectral dens ity, and B^ denotes the single -sided loop bandwidth. 
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D 


m 


(B-2) 


K~ D_. + 


K t B.T 
L x 


D m 1 2R 


where 


/ CO 

S m (f) j G( j 2irf) 

“CO 


df 


(B-3) 


K is a constant dependent only on the filter type and is defined by 
L 


G(j2TTf) 


df 


v ^ tL 

= / * c0 


G(j2TTf) 


(B-4) 


df 


is a constant dependent on both the baseband data power spectrum and the 
filter type, i. e. 


S (f) 
m 


G(j2irf) 


df 




d “ r 

J — Q 


s (f) 

m' ' 


G(j2irf) 


(B-5) 


df 


and B. denotes the two-sided noise bandwidth of the arm filter G(j2Trf), i. e. , 


B. = 


G(j2Trf) 


df 


(B-6) 
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Furthermore, R^ = ST/N^ denotes the data (symbol) signal -to -noise ratio. 
For single pole RC arm filters characterized by 


G( i 2-rrf) 


(B-7) 


1 +1 


=1/2 and the 3 dB cutoff frequency f c is related to the two-sided noise band- 
width B. by B. = TTf^. Thus, (B-2) simplifies to 


D 




m 


D __ + 


7Tf T 
c 


(B-8) 


D m 4R 


In order to simplify (B-8) any further, we must specify the spectrum of 
the data modulation or equivalently the statistics of the data symbol sequence. 
For the optimum rate 1/4, constraint length 3 convolutional code, we have from 
(22) and (34) that* 


S (f) a T 

m 


sinTrfT 

TtfT 


Me 


2 cos 2-rrfT + cos 4irfT 


3 } 


(B-9) 


Substituting (B-7) and (B-9) into (B-3) and (B-5) yields after much 
simplification 


m 


. / - 2'frf T\ -2trf T 

1 - (l - e c ) + \l - e c > 


2tt£ T 
c 


4uf T 
c 


(B-10) 


,1 - e 


-4uf T 
c 


l6iTf T 
c 


❖ 


Note that S m (f) is used here rather than S c (f) as in (22) since the modulation 
power spectrum in this case contains only a continuous component. 
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■2tt£ T 

+ 2irf T ) e c 
c 


(3 + 27rf c T) 


K n D 
D m 


= 1 - 


4tt£ T 
c 


(B-ll) 


' -2rrf T 

, c 

1 - e 

2rr£ T 
c 


O 1 , . -2irf T 

i.i(3 + 4rfT)e c 


-4tt£ T 


+ 1 


1 - e 


8trf T 
c 


o t / \ “4TTf T 

(3+8Trf c T)e c 


For an uncorrelated rate 1/4, constraint length 3 convolutional code, the 
tracking performance results would be equivalent to those of an uncoded data 
sequence (except for a frequency scale factor). Thus, (B-l) and (B-9) still 
apply with, however, (B-9) through (B-ll) replaced by the simpler expressions 



D 

D m 


= 1 - 


(3 + 27 Tf c T) 


- 2tt£ T 
c 


4irf T 
c 


(B- 12) 


(B- 13) 


(B-14) 
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